Google Search Review Scrapping

by: ElisonC, 8 years ago

Last edited: 8 years ago

   So I am going to buy a new laptop and there is a lot of reviews out there, and I mean a lot. So when I went to search for Razer Blade Stealth Reviews I saw these
( https://drive.google.com/file/d/0B_tLT_orfWt6Y3gyNXhveHZ1N1k/view?usp=sharing )
That is a link to a picture of the stars. The stars are right below the url.
So I then clicked on the stars and pressed inspect element which would lead me to this code.
<span style="width:53px"></span>
I then found if you change the 53 it would change the amount of stars. 66 being 5 stars, and 13.2 being an individual star. I then could take that data and many other reviews and find the average review among many website. BUT the problem is when I do ...

url = https://www.google.com/search?q=razer+blade+stealth+review&start=0
source = urllib.request.urlopen(url).read()
soup = bs.BeautifulSoup(source, 'html.parcer')
print(soup)


There is never a string of...
<span style="width:53px"></span>
Is there a way to do this? Is it even possible?


You must be logged in to post. Please login or register an account.



Pretty sure html.parcer is a typo, probably should be html.parser.

As for your issue, maybe that html is being filled dynamically, you can check out https://pythonprogramming.net/javascript-dynamic-scraping-parsing-beautiful-soup-tutorial/ for more information and to see if that method solves your problem.

-Harrison 8 years ago

You must be logged in to post. Please login or register an account.